35. Notebook + Quiz: Multiple Tests

Workspace

This section contains either a workspace (it can be a Jupyter Notebook workspace or an online code editor work space, etc.) and it cannot be automatically downloaded to be generated here. Please access the classroom with your account and manually download the workspace to your local machine. Note that for some courses, Udacity upload the workspace files onto https://github.com/udacity , so you may be able to download them there.

Workspace Information:

  • Default file path:
  • Workspace type: jupyter
  • Opened files (when workspace is loaded): n/a

Quiz 1 : What does a p-value signify in this example?

SOLUTION: The probability of us observing the facts about an individual's case that are in favor of them being guilty, assuming they are truly innocent.

QUIZ QUESTION: :

Quiz 2: Match the description to each correct value for this case.

ANSWER CHOICES:



Value

Description

The probability of us observing the facts about an individual's case that are in favor of them being guilty, assuming they are truly innocent.

The probability of an individual being innocent.

The threshold for the percentage of type I errors we are willing to commit.

Deciding an individual is guilty, but they are actually innocent.

Deciding an individual is innocent, but they are actually guilty.

The probability of an individual being guilty.

SOLUTION:

Value

Description

The probability of us observing the facts about an individual's case that are in favor of them being guilty, assuming they are truly innocent.

The threshold for the percentage of type I errors we are willing to commit.

Deciding an individual is guilty, but they are actually innocent.

Deciding an individual is innocent, but they are actually guilty.

QUIZ QUESTION: :

Quiz 3:

ANSWER CHOICES:



Description

Value

0.0000069

6.8%

0

0.002

0

SOLUTION:

Description

Value

0.0000069

0

0

0.002

0

0

Quiz 4: Why is this not how multiple comparison tests work in practice?

SOLUTION: Hypothesis testing is used on parameters. This is looking at individuals in a population, not aggregates.